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This  paper  studies  the  performance  of  the  two  dimensional  least  mean  square  adaptive  filter  as  a  prewhiten- 
tng  filter  for  detection  systems  In  two  dimensional  infrared  sensor  data,  the  clutter  is  correlated  and 
much  wider  in  spatial  extent  than  the  signal  of  interest.  The  two  dimensional  adaptive  filer  can  be 
trained  to  adapt  and  predict  the  clutter,  thereby  enabling  the  error  channel  output  to  contain  the  signal 
of  interest  in  white  noise  Performance  of  the  adaptive  prewhitener,  in  terms  of  local  signal  to  clutter 
ratio'sf LSCR)  and  the  gain  obtained  is  described.  The  gain  in  LSCR  due  to  this  augmenting  filter, 
is  shown  to  depend  on  the  statistics  of  the  background  clutter,  in  particular  on  the  local  mean  It  is 
shown  that,  as  the  amount  of  color  in  the  background  clutter  increases,  the  performance  of  the  conven¬ 
tional  matched  filter  performance  degrades  much  more  than  the  performance  of  a  detector  based  on  the 
augmenting  prewhitener. 


1.  INTRODUCTION 

In  this  paper  we  describe  the  performance  of  adaptive  whitening  filters  when  used  for  small  target 
detection  in  two  dimensional  image  data.  The  problem  of  small  object  detection  from  cluttered  image 
scenes  is  of  interest  in  a  number  of  applications  ranging  from  that  of  infrared  target  detection  to  medical 
imaging  In  these  applications  the  object  of  interest  is  of  a  very  small  spatial  extent  and  is  masked  by 
clutter  of  a  much  larger  spatial  extent.  In  this  paper  we  look  at  some  adaptive  techniques  used  to  cancel 
such  correlated  clutter  from  two  dimensional  infrared  image  data 

Most  detection  systems  for  such  small  targets  model  the  underlying  clutter  A  number  of  image 
representation  models  ranging  from  the  white  noise  driven  representations  to  the  minimum  variance  pre¬ 
diction  representations  have  been  proposed.1,2  Prediction  based  methods  which  use  general  image  models 
and  estimate  the  linear  prediction  coefficients  at  each  pixel  have  been  applied  to  object  detection  3  For 
infrared  clutter,  other  models  and  detection  schemes  have  been  developed  Takken  el  al  A  6  developed 
a  spatial  filter  based  on  least  mean  square  optimization  The  filler  was  designed  l<>  maximize  the  signal 
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where  j  is  the  iteration  number  The  image  is  sranneti  from  toji  lo  bottom  am)  left  to  riglil  (lexicograph¬ 
ically)  and  hence  j  is  found  as  j  -  mM  +  n  Here  X  is  the  input  image,  Y  the  predicted  image  and  W , 
the  weight  matrix  at  the  j'h  iteration  The  images  are  assumed  lo  be  square  of  size  M  x  M  pixels  and 
the  weight  matrix  (hence  the  window  size  of  the  pixels  being  used  to  predict)  is  taken  lo  be  square  of 
size  /V  x  /V  This  predicted  value  is  compared  with  a  reference  and  the  residual  is  the  error  between  the 
two  given  by 

E(m,  n)  =  t}  =  D(rn,  n)  —  Y(m,  n)  (3) 

where  D  is  the  reference  image.  In  the  line  enhancer  conmfiguration  this  reference  is  a  shifted  version 
of  the  input  image.  The  weights  are  updated  by  using  instantaneous  estimates  of  the  autocorrelation  of 
the  noise  and  the  cross  correlation  between  the  reference  and  the  input  and  then  using  a  steepest  descent 
direction.16  The  update  equations  then  become 


WJ  +  l(l,k)=WJ+»tJX(m-l,n-k)  l,k  =  0,.  ,N-  1  (4) 

where  //  is  the  adaptation  parameter.  Under  stationary  conditions,  it  can  be  shown  that  the  weights  of 
this  filter  converge  to  the  solution  of  the  two  dimensional  Weiner-llopf  equations,  provided  fi  is  chosen 
to  be  within  the  bounds  required  for  stability.19 

Knowing  the  difference  in  the  correlation  lengths  of  the  signal  of  interest  and  the  clutter  in  the  image 
it  is  possible  to  find  bounds  on  p  such  that  this  TDLMS  based  adaptive  filter  predicts  the  clutter  but 
not  the  signal  of  interest.20  Thus  a  seperation  of  the  signal  and  the  clutter  is  obtained  by  the  use  of  such 
an  adaptive  filter  The  error  channel  output  of  this  filter  (which  now  ideally  contains  only  the  signal  of 
interest  and  white  noise)  can  be  used  for  a  matched  fitering  operation  and  thus  the  detection  statistic 
can  be  generated 


2.2.  Filtering  Performance 


'l'he  performance  of  such  a  adaptive  clutter  whitener(ACW)  based  detection  system  was  studied.  Both 
the  filtering  and  detection  performance  for  structured  background  clutter  and  real  infrared  data  were 
studied  The  filtering  performance  was  characterised  by  the  local  signal  to  noise  raho(LSCR)  defined 
in  a  window  of  interest.  Thus,  if  the  window  of  interest  were  a  rectangular  region  defined  from  (Lx,  Ly) 
to  (//r,  // y),  then  the  LSCR  (in  dB)  is  defined  as 


LSCR  =  10  log10 
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where,  mw  is  the  mean  of  the  noise  in  the  window  and  ow  is  the  variance  And  the  gam  (in  dB)  provided 
by  such  a  filter  is  then  given  by 

Gain  =  LSCRou,  -  LSC R,n  (6) 


Fig  la  shows  the  input  image  used  for  some  of  the  simulations  This  image  is  part  of  a  6  channel 
mnltispectral  dataset  collected  by  a  NASA  Thermal  Infrared  Multispectral  Scanner  (TIMS)  sensor  and 
is  of  a  rural  background  over  the  hills  of  Adelaide,  Australia  An  artificial  target  2x2  pixels  in  extent 
was  inserted  into  this  background. 

For  a  very  high  LSCR  the  output  of  the  ACW  is  shown  in  Fig  lb  It  is  seen  that  most  of  the  correlated 
background  clutter  is  predicted  and  hence  the  residua!  contains  very  little  correlated  background  clutter 
The  target  is  not  predicted  and  is  present  in  the  error  output  of  the  ACW 

The  performance  of  this  ACW  depends  on  p  Fig  2  shows  the  LSCR  gain  obtained  as  a  function  of  the 
adaptation  parameter  It  is  seen  that  as  p  is  increased  beyond  an  optimum  and  approaches  the  stability 
bounds,  the  performance  of  the  ACW  degrades  very  fast  This  is  a  result  of  two  factors  First,  increasing 
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Figure  3  Gain  vs.  Input  LSCR  for  target  position  100,100 


the  p  allows  the  filter  to  predict  the  signal  of  interest  and  thus  some  of  the  target  energy  is  cancelled 
in  the  output.  Second,  as  p  approaches  the  stability  bound  of  the  filter  the  weight  misadjustment  noise 
increases. 

It  is  also  seen  that  as  p  is  decreased  below  the  optimum,  the  performance  of  the  ACW  degrades, 
though  not  as  drastically  as  that  in  the  upper  bound  case  This  degradation  is  because,  with  the  slower 
adaptation  parameter,  the  filter  is  unable  to  accurately  predict  the  clutter  in  the  environment 

2.3.  Comparison  with  Local  Demeaning 

It  has  been  shown  that  the  removal  of  the  local  mean  from  an  image  causes  the  image  statistics  to  become 
Gaussian  and  also  removes  any  spatial  correlation,  thus  “whitening”  the  image. 7'11  Consequently,  the 
local  demeaning  filter  is  an  alternative  technique  for  whitening  the  image.  In  this  section,  the  comparitive 
performance  of  the  adaptive  clutter  whitening  filter  and  the  local  demeaning  filter  will  be  obtained 

The  amount  of  LSCR  gain  obtained  by  such  a  system  can  be  calculated  theoretically  since  the  target 
inserted  in  the  image  is  known  completely  If  mj  is  the  mean  of  the  background  clutter  using  a  window 
of  the  same  size  as  that  used  for  the  local  demeaning  and  ma  is  the  value  of  background  clutter  at 
the  pixel  of  interest  Then  the  output  of  the  local  demeaning  filter  at  that  pixel  will  be  sn  -  mi,  and 
that  of  the  TDLMS  will  be  s„  -  m„,  where  s/  is  the  intensity  of  the  pixel  with  the  signal  present.  The 
theoretical  plots  are  based  on  the  assumption  that  the  TDLMS  has  converged  fully  and  is  able  to  predict 
the  background  clutter  without  any  leakage  of  the  clutter  into  the  error  channel. 

Fig. 3  shows  the  gain  in  the  output  as  a  function  of  the  LSCR  in  the  input  for  a  2  x  2  target  located 
at  (100,100)  At  this  position,  mi  <  ma  and  TDLMS  shows  more  gain  than  the  local  demeaning 
algorithm 

However  Fig  4  shows  the  gam  in  the  output  as  a  function  of  the  input  LSCR  for  a  target  position  of 
( 105, 105)  where  m(  >  ma ,  and  the  local  demeaning  filter  is  seen  to  perform  better  than  the  TDLMS  This 
is  primarily  because  the  dominant  component  of  the  clutter  is  a  d  c  (in  the  spatial  sense)  component 
which  can  then  be  removed  by  a  local  demeaning  operation  arross  the  image 

However  for  images  that  do  not  have  a  strong  d  c  component  but  have  a  highly  correlated  clutter 
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(a)  Output  from  TDLMS 
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Figure  6:  The;  Performance  of  the  TDLMS  anti  tl&c  Local  Demeaning  filter  for 
structured  sinusoidal  clutter 

structure,  the  local  demeaning  filter  fails  to  remove  the  background  clutter,  while  the  TDLMS  is  able  to 
predict  the  correlated  clutter.  This  is  seen  in  Figure  5  which  shows  the  input  being  a  two  dimensional 
sinusoid  with  a  2  *  2  target.  The  TDLMS  output  shown  in  Fig.Ga  is  seen  to  have  only  the  target,  while 
the  output  of  the  local  demeaning  is  seen  to  contain  sinusoidal  clutter  as  well(Fig.fih). 

Thus  we  see  that  the  TDLMS  based  adaptive  filter  can  whiten  clutter  without  also  removing  the 
target,  when  the  clutter  is  structured.  However  the  performance  depends  on  the  local  statistics  of 
the  image  The  detection  performance  of  such  ACW  augmented  receivers  in  the  presence  of  highly 
structured  noise  has  been  characterized  and  HOC  curves  plotted  using  Monl-Carlo  methods.1'  It  has 
been  shown  that  ;ls  the  amount  of  color  in  the  background  clutter  increases,  the  detection  performance 
of  the  augmented  matched  filter  doe;;  not  degrade  as  much  as  that  of  the  conventional  matched  filler 


3.  ADAPTIVE  RECURSIVE  DETECTION 

T.  I .  Weighted  Estimation 

Another  approach  to  the  target  detection  problem  consists  of  estimating  the  noise  an  ton  >r  relation  matrix 
and  calculating  the  detection  statistic  directly  from  Kq.I.  The  sampled  matrix  inversion, >l  the  modified 
sampled  matrix  inversion*’'*  and  the  generalized  likelihood  cat detectors  belong  m  tins  class  Tin- 
estimation  is  usually  done  .ls  a  maximum  likelihood  estimation  using, 

*1 
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(a)  Target  Kinl)C<l(lfd  in  Infrared  Image  Dal  a 


(b)  Detection  Statistic 


Figure  7:  Typical  Input  and  Output  for  Recursive  Estimation  Based  Detection  with  A  -  0  99 


Now  if  the  detector  is  designed  for  a  constant  false  alarm  rate  operation  (CFAR),  Pja{i «)  =  P/„(n  -  1 ) 
Further  if  the  rate  of  non-stationarity  is  small  we  can  show 


0  Yrfc[C'd  +  Ad] 


chore 
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and  ft  :=  srA*s  II  ere  A‘t  is  the  change  in  the  tnverse  of  the  autocorrelation  of  the  non-stationary  noise 
input  and  is  given  hy 

A*  = -  1)  (21) 


Equations  17  to  21  thus  define  the  relationship  between  the  probability  of  detection  {Pd),  tbe  rate  of 
non  stationarity  of  the  noise  (Ad*)  and  the  weighting  factor  of  the  weighted  update  (A).  A  proper  choice 
of  A  depends  on  the  autocorrelation  matrix  oT  the  noise,  and  can  influence  the  probability  of  detection 
A  two  dimensional  version  of  the  recursive  detection  procedure  can  be  formulated  by  ordering  the 
data  matrix  into  a  vector  lexicographically.  Such  a  matched  filter  was  used  in  a  noise  canceller  structure 
for  imilli  spectral  images.  A  typical  input  image  (with  an  artificially  inserted  target)  and  the  resulting 
detection  statistic  are  shown  in  Figures  7a  and  7b  It  is  seen  that  due  to  the  adaptive  estimation  of  the 
autocorrelation  matrix,  the  matched  filter  is  able  to  follow  the  changes  in  the  stat  istics  of  the  background 
•  lulter 
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